ADAPTATION OF LAMBDAMART MODEL TO SEMI-SUPERVISED LEARNING
نویسندگان
چکیده
The problem of information searching is very common in the age internet and Big Data. Usually, there are huge collections documents only multiple percent them relevant. In this setup brute-force methods useless. Search engines help to solve optimally. Most based on learning rank methods, i.e. first all algorithm produce scores for they feature after that sorts according score an appropriate order. There a lot algorithms area, but one most fastest robust ranking LambdaMART. This boosting developed supervised learning, where each document collection has estimated by expert. But usually, contain tons their annotation requires resources like time, money, experts, etc. case, semi-supervised powerful approach. Semi-supervised approach machine combines small amount labeled data with large unlabeled during training. Unlabeled data, when used combination quantity can significant improvement accuracy. paper dedicated adaptation LambdaMART learning. author proposes add different weights training procedure achieve higher robustness proposed was implemented using Python programming language LightGBM framework already implementation For testing purposes, datasets were used. One synthetic 2D dataset visual explanation results two real-world MSLR-WEB10K Microsoft Yahoo LTRC.
منابع مشابه
Semi-supervised speaker adaptation
We developed powerful unsupervised adaptation methods for speech recognition, i.e., the system improves its performance while the user uses it. No prior enrollment phase is necessary where the speaker has to read a given text. We tried to further improve the unsupervised adaptation by using confidence measures. These give an estimate of how likely the recognized words were correct. Adaptation t...
متن کاملSemi-Supervised Learning Based Prediction of Musculoskeletal Disorder Risk
This study explores a semi-supervised classification approach using random forest as a base classifier to classify the low-back disorders (LBDs) risk associated with the industrial jobs. Semi-supervised classification approach uses unlabeled data together with the small number of labelled data to create a better classifier. The results obtained by the proposed approach are compared with those o...
متن کاملLearning to Model Spatial Dependency: Semi-Supervised Discriminative Random Fields
We present a novel, semi-supervised approach to training discriminative random fields (DRFs) that efficiently exploits labeled and unlabeled training data to achieve improved accuracy in a variety of image processing tasks. We formulate DRF training as a form of MAP estimation that combines conditional loglikelihood on labeled data, given a data-dependent prior, with a conditional entropy regul...
متن کاملCoupled Semi-Supervised Learning
This thesis argues that successful semi-supervised learning is improved by learning many functions at once in a coupled manner. Given knowledge about constraints between functions to be learned (e.g., f1(x) → ¬f2(x)), forcing the models that are learned to obey these constraints can yield a more constrained, and therefore easier, set of learning problems. We apply these ideas to bootstrap learn...
متن کاملSemi-supervised Learning
Semi-supervised learning uses both labeled and unlabeled data to perform an otherwise supervised learning or unsupervised learning task. In the former case, there is a distinction between inductive semi-supervised learning and transductive learning. In inductive semi-supervised learning, the learner has both labeled training data {(xi, yi)}i=1 iid ∼ p(x, y) and unlabeled training data {xi} i=l+...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Vestnik Nacional?nogo tehni?eskogo universiteta "HPI"
سال: 2023
ISSN: ['2079-0775']
DOI: https://doi.org/10.20998/2079-0023.2023.01.12